How do I get past the ogre? [Screen B]

Hint 1 of 2:

If you're strong enough, you can fight him for some money.

Hint 2 of 2:

But you really don't have to get violent if you don't want to.